🕷️️ Job Radar • SCRAPING

upwork.com 🟡 2026-05-02

🔹 Large-Scale Trustpilot Data Extraction
👤 Client: 🇫🇷 France Member since 2025-09-19
💰 Price: $50
🚩 Problem: Extract data from over 1 million Trustpilot pages.
📦 Existing: Not specified

Specifications:

[Target] Crawl and extract data from 1,000,000+ Trustpilot pages.
[Method] Use robust scraping techniques to handle large-scale operations including anti-bot measures and rate limits.
[UI/UX] Not applicable (backend task).
[Stack] Python with libraries like Scrapy or Beautiful Soup; Proxy management tools; CSV handling.
[Security] Ensure data privacy and compliance with Trustpilot terms of service. Implement secure proxy usage.
[Format] Deliver clean, deduplicated dataset in CSV format.

Workflow:

Set up scraping environment with necessary libraries and proxies.
Develop scraper to extract required fields (Trustpilot URL, domain name, rating, email).
Implement anti-bot measures and handle rate limits.
Run the scraper on a subset of pages for testing and optimization.
Scale the operation to process 1,000,000+ pages.
Clean and deduplicate extracted data.
Export final dataset in CSV format.